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Abstract — We investigate threshold-based multi-trial decod- 
ing of concatenated codes with an inner Maximum-Likelihood 
decoder and an outer error/erasure -^-extended Bounded 
Distance decoder, i.e. a decoder which corrects e errors and r 
erasures if ^^e+r < d° — 1, where d° is the minimum distance of 
the outer code and £ G N\{0}. This is a generalization of Forney's 
GMD decoding, which was considered only for £ = 1, i.e. outer 
Bounded Minimum Distance decoding. One important example 
for -^-extended Bounded Distance decoders is decoding of 
i'-Interleaved Reed-Solomon codes. Our main contribution is 
a threshold location formula, which allows to optimally erase 
unreliable inner decoding results, for a given number of decoding 
trials and parameter £. Thereby, the term optimal means that the 
residual codeword error probability of the concatenated code is 
minimized. We give an estimation of this probability for any 
number of decoding trials. 

I. Introduction 

One of Forney's seminal contributions to algebraic coding 
was the invention of Generalized Minimum Distance (GMD) 
decoding [1|, [2|. It provides a means to exploit soft informa- 
tion from the channel using a hard-decision algebraic decoder 
by multi-trial error/erasure decoding with a varying number 
of erased unreliable input symbols. Most intriguing about the 
GMD scheme is that it performs as good as Maximum Likeli- 
hood (ML) decoding if the channel is good. This gives rise to 
the frequent application of GMD decoding for concatenated 
codes. There, the inner code is responsible for correcting a 
considerable amount of transmission channel eiTors. Thus, the 
input symbols for the outer decoder can be viewed as being 
transmitted over a super channel, which is composed of the 
transmission channel and the inner decoder This super channel 
is always good if the parameters of the inner code are chosen 
appropriately. 

Any decoder's performance can be measured by its guar- 
anteed decoding radius and its residual codeword eiTor prob- 
ability, the latter one being a function of the channel. The 
fundamental research problem of threshold-based multi-trial 
decoding is to find for z G N \ {0} the set of thresholds 
r = {r|^\...,Ti'='}, T^^^^ < r^.^\, wWch optimizes 
the respective performance measure. Generally, the output of 
multi-trial decoding is a result list. In this paper, we denote 
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the case that the transmitted codeword is among the elements 
of the result list as a decoding success. Both the decoding 
radius and the residual codeword error probability are to be 
understood in this context. 

Maximization of the guaranteed decoding radius of GMD 
decoding for concatenated codes was considered by Blokh 
and Zyablov [3|. Using Linear Programming, they obtained 
optimal threshold sets when both inner and outer code are 
BMD-decoded. In previous work (U, ||5l, we generalized their 
result to the case where the outer code is X-extended Bounded 
Distance fABDj-decoded for the full (real) range 1 < A < 2. 

Blokh and Zyablov also considered the probably more prac- 
tical performance measure, i.e. minimization of the residual 
codeword error rate. For concatenated codes with inner ML 
and outer BMD decoding they derived optimal threshold sets 
using results on the Binary Symmetric Channel (BSC) error 
exponent from Gallager O, JT) and Forney |8|. In this paper, 
we tackle the generalization to the case of an outer ^-j^- 
extended Bounded Distance (^^BD) decoder, building up on 
our previous results [9|. Thereby, £ e N \ {0}. 

The paper is organized as follows. In Section|II] we describe 
the structure and threshold-based multi-trial decoding of 
concatenated codes, in Section Hill we derive necessary and 
sufficient conditions for an optimal threshold set. We do this 
on a high level, using the error- and erasure probabilities 
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parameters. In Section |IV] we recall Forney's generahzation 
of Gallager's error exponent of the BSC channel in the 
eiTor/erasure decoding case. Simple approximations of the 
eiTor- and erasure probabilities are derived in Section [V] This 
allows to analytically calculate the set of optimal thresholds 
in Section [Vl] together with results on the residual codeword 
eiTor probability. In Section IVIII we wrap up the paper and 
draw conclusions for further research. 

II. GMD Decoding of Concatenated Codes 

A concatenated code C(n, fc, d) consists of two constituent 
codes C'{¥2]n\k' ^ m,d') and C°{W2'^;n°,k°,d°). We 
denote C as the inner code, C° as the outer code and C as the 
concatenated code. Since C is binary, such is C. W.l.o.g. we 
restrict ourselves to this most practical case. 

An information vector a° e F§m is first encoded into a 



codeword c° 



G C° C 



The 2™-ary symbols c°, j 



0, . . . , n° — 1, of c° are then converted into binary vectors 
a^- G F§ and encoded into e C C F2 • The binary matrix 
consisting of the is then transmitted over a BSC channel 
with crossover probabihty e. 

At the receiver, erroneous vectors := + are 
received. They are fed into an ML decoder dec'(-) for C'.The 
resulting codeword estimates := dec'(r^) are mapped 
to their information vectors and converted into symbols 
r° G U {X}, where X is the erasure symbol. The vector 
r° := (rg, . . . , r°o_i) and the number z G N \ {0} of 
thresholds are the input for the GMD decoder of C°. 

Inside the GMD decoder, r° is processed in the following 
way. First, for every symbol r° = aj, the reliability value vj. 
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is calculated. Then, the threshold set T = \tI^\ . . . ,ri^^|. 



T^'^ < T^+i, is applied as 
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resulting in an input list X {r°,...,r^}, where :— 



■ • ' ' fc,i 



j^). Thus, a decoding result of the inner de- 



coder is discarded in decoding trial fc, fc = 1, . . . , z, if its 
reliability value falls below the threshold . Finally, an 
error/erasure ABD decoder (in our case A = is applied to 
every element of X resulting in a result list TZ := {c°, . . . , c°}. 
Whenever c° G 7?, we have a decoding success. 

III. Necessary and Sufficient Conditions 

This section generalizes our result from [|9j which was 
obtained for the simple case where the inner code is BPSK 
modulation and the outer ^^^^BD decoder has parameter £ = 1, 
i.e. it is a BMD decoder 

Considering (|2]i, it is clear that two cases can occur while 
advancing from threshold T^^^ to xj.^^. First, it is possible 
that a correct symbol from the super channel is erased for 

i z) ( z) 

T^^^j^ while it was not for Xj: '. Second, it is possible that a 

wrong symbol is erased for xj^^-^ while it was not for xjf\ 
The probabilities for these two cases are defined by 



Pk 



Pr [correct symbol erased for xj,^-^ but not 



:= Pr (erroneous symbol erased for xjf^^ 



1, 



but not X, 



(^) 



z — 1. Additionally, we define 

Pr := Pr(correct symbol never erased) 

Pc := Pr(correct or erroneous symbol always erased) 

pi := Pr(erroneous symbol never erased) 

for the three border cases. We shall find useful approximations 
for these probabilities in Section |V] Note, that Pr + Pc + Pi + 

Ell\iPk+PJ ^ 1- 



With each of the probabilities we associate the number 
of symbols from r° falling into the case, i.e. tr,tc,ti,tk,t^.- 
Obviously, U + tc + ti + ElZlitk + tk) = n°. 

Let e{k) and T(fc) be the numbers of erroneous and erased 
symbols, respectively, in f^. An ^^i-i-BD decoder for C° 
succeeds in decoding as long as 

^^■e(fc) + r(fc) <d°-l. (3) 
This inequality can be expressed by tr,tc,ti,tk,ti^ as 
i+1 f \ ''^^ - 

—^[ti + Y,tJ+tc + Y,{'t'^+i.)<d°-l, (4) 

V u=k I v=\ 

since it follows from (|2|i and the orderliness of the threshold 

(zl {,z\ 

set that a symbol is erased by X^j^^ Tz if it is erased 
by x\f^ . Unequality (HI is then obtained by simply counting 
all symbols which are errors and erasures, respectively, for 
decoding trial k and replacing e(fc) and r(fc) in (|3]l. Let 
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Then, by 

p V'i : ''C7 ^r: iil I ''1 J • ■ • : iiz J f-z/ 

we obtain an exact formula for the residual codeword error 
probability of the GMD decoder with C = Ci. We can replace 
the condition by 

\/ k = \, . . . , z 



+ + + E =d°-l 



=fc / u=l 

to obtain a good approximation of P^. for C = C2. Condition 
C2 can be compressed to 

z-l 



e + 1 



ti+t, + {£+l)Y,tk^d° -1 



k=l 



if we consider V : k = 1, . . . , z : tf^ = itk- The latter set of 
equalities can be seen by subtracting two subsequent equations 
of C2 from each other. Since the super channel can be assumed 
to be good, we can further approximate Pe by 

Pe « m^ax p\? n (/^pS"- I . (5) 

The previous observations allow to prove the following 
theorem. 



Theorem 1 The following conditions are necessary and su 
ficient for an optimal threshold set 7" — ^X^^\ . . . ,Xz^"^ 
which minimizes the residual codeword error rate P^. 



Pc = (£iPi)^ 



(6) 
(7) 



and 

\fk^l,...,z-2:plp,=pl^^p,+,. (8) 

Proof: Equivalent to the maximization in (|5]l, we can also 
express the approximation for in logarithmic form, i.e. 
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U ln{pi) + tc ln{pc 
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Then, the maximization term is a linear function of the 
ti,tc,ti, . . . ,tz — 1. Thus, its maximum is attained at some 
boundary point fulfilling condition C3, i.e. 



HPe) 



i-{d°- 1) 



i+1 
d° — 1 

d° — 1 

Hp' 



Hpi),id°'i)Hpc), 



£ 



e + 1 



In non-logarithmic form: 
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Let T fulfill the statement of the theorem and let T' be a 
set of thresholds where at least one threshold is different than 
in T. Assume that T' is optimal. The only possible way for 
T' to achieve a smaller Pg would be to decrease all terms 
in (|9]l simultaneously. This is impossible, decreasing any of 
the probabilities pi,pc,p^^Pi, . . . ,p^^_-^Pz-i would increase at 
least one of the others. This proves that T is both unique and 
optimal. ■ 

IV. Forney's Generalization of Gallager's Error 
Exponent 

Let us for a while consider one specific decoding trial k, 
k £ {l,...,z} and the corresponding threshold T :— Tjf\ 
Reliability values are calculated according to ^ and thresh- 
olds are applied as in Q. Hence, by erasing, the inner ML 
decoder becomes a decoder with erasing option. Its decoding 
criterion is defined by 



dec'(r') = c' 



Pr(r'|c') 



cieC'\{di} 



Pr(ri|ci; 



>expTn'. (10) 



It was shown by Forney that this criterion is optimal in a 
sense that no other criterion can decrease both the error and 
error-or-erasure probability JS). In the same publication, it 
was shown that both probabilities can be expressed in terms 
of Gallager's error exponent for the BSC ||6l, [TJ. They are 
given by 



Pe 

PB,X 



exp 
exp - 



s T) n' 
sT) n} 



(11) 
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where Eo{R^) is Gallager's exponent and s the corresponding 
optimization parameter, < s < i. 



V. Approximated Probabilities 

In this section, we shall find simple approximations for 
the probabilities pj.,p^,pc, and pi, which were defined in 
Section |III] The approximations are required to obtain an 
analytic threshold location formula fulfilling the necessary 
and sufficient conditions of Theorem [T] Let us start with 
the following observation. With Gallager's exponent, the error 
probability of an ML decoder is exp ~{Eo{R^))n\ For such 
decoding, there exists a Hamming distance radius A S N 
such that decoding of r' with dH(r',c') < A almost always 
succeeds and decoding of r' with dH(r',c') > A almost 
always yields an erroneous result. This radius can be thought 
of as an approximation of the borders of the Voronoi cells of 
c' G C. For decoding with erasure option as in (fTOl i and the 
error exponents from (fTTT l and (fT2l l this gives the following 
approximations of p^ and pb.x- Recall, that e is the crossover 
probability of the BSC. 



^'E.x^ E ^;h''(l-e)"-^ 

i/=Ae.x 



Ae, Ae,x G N. Since pE < Pe,x, we also have Ae < Ae,x- 
Of course, the probabilities and radii vary for different thresh- 
olds. Hence, we append the threshold index as a parameter, 
i.e. we denote the probabilities and radii for k = l,...,z 
by pE{k),PE,x{k), A^ik), and AE,x(fc), respectively. Note, 
that from T^.''^ < T^^\ follows AE,x(fc) > AE.x(fc + 1) and 

AE(fc) < AE(fc + l). 

Let us consider the probability pc for a symbol, which is 
erased for each threshold from T. Its Hamming distance to the 
transmitted codeword must be at least Ae,x(1) and at most 
Ae(1) — I. Otherwise, there would be a threshold for which 
the symbol would not be erased. Consequently, we have 



Ae(1)-1 

- E 

iy=AE,x(l) 



e-(l_e)"'-''=pE,x(l)-PE(l). (13) 



Now, let us approximate the probability pi for a wrong 
symbol which is never erased. Its Hamming distance to the 
transmitted codeword must be at least A-e{z). We obtain 



Pi 



Pe{z). (14) 



The probabilities pf.,p^, k — 1, . . . , z — 1, can be approx- 
imated as follows. Symbols counting towards Pf. must lie 
between AE,x(fc + 1) and AE,x(fc) — 1 as can be seen in 
Figure [T] Forp^ we observe that the symbols must lie between 



AE(fc) and AE(fc + 1) - 1. We obtain 

Ae,x(A;)-1 . 

fc = AE,x(fc+l) ^ ^ 

= PE,x{k + 1) - PE,x(fc) - (pE(fc) - PE(fc + 1)) (15) 
AE(fe+l)-l 



fc = AE(fc) 

PE(fc) -PE(fc + !)• 



(16) 




We express ^ and ([8]) in the same way and obtain 

Pc = b^Pi)^ ^ 



(18) 



and, Vfc = 1, . . . ,z - 2, 

o = ^r(^)-(^ + i)Ti^\ + r,«- 



(19) 

(2) I 



Theorem 2 T/ze optimal threshold set T = ^T^^ 
for GMD decoding of a concatenated code, with inner ML arid 
outer ^^BD decoding, £ € ¥l\ {0, 1}, is given by 



_ Eq{r') + 1) - 2£^{e + i~i) + £'^ + e) 



'{£^{P + + P ~ P - 2e) 



(20) 



where Eq{R^) is Gallager's error exponent for the BSC and 
s is the corresponding optimization parameter, < s < ^. 

Proof The statement is given by the unique solution of 
the recun-ence relation ([T7]l, ([TSll, and (O for f e N \ {0, 1}. 



Fig. 1. Radii for the case z = 2. 

With equations ( fT3] l. ( fT4l i. ( fTSl ). and ( fT6] l we expressed the 
probabilities pcPi^p^., and in terms of the probabilities 
PE(fc) and pe,x(^), for which we can use the error- and 
erasure exponents from ( fTTT i and ( fT2] i. respectively. After 
some rather technical simplifications, this yields the following 
simple expressions. 

Lemma 1 The probabilities pc,pi,Pk, and p^ can be approx- 
imated by 



Pc 

Pi 
Pk 



Ek 



exp-{EoiR')-sTl 
exp 
exp 
exp 
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VI. Optimal Thresholds and Residual Codeword 
Error Probability 

With the results from Sections llll] and W\ we can now 
derive an analytic formula for the optimal thresholds , 
k = 1, . . . , z. Consider Theorem[T] It basically states a system 
of z equations, the optimal threshold set with z elements 
being its solution. Let us express the equations using the 
approximated probabilities from Lemma [T] For (|6]l, this gives 



f+i 



Eo{R' 



Pi 



Pc 

^ EoiR') 

e 



(^) 



-ri^) + Ti'^'. (17) 



{i+l)s £ + 



Corollary 1 For outer BMD decoding, i.e. £ — I, the optimal 
threshold set is given by 



T, 



(2) 



Eo{R}){2k-l) 



s{2z + 1) 

Proof: The statement is given by the unique solution of 
the recurrence relation ( [TtT i. ( fTsT i, and ( fT9b fox £^l. ■ 

The corollary coincides with the results of Blokh and 
Zyablov |3|. Thus, we obtain their result as a special case 
of our main result, i.e. Theorem |2] Note, that both i?o(i?') 
and s - and thereby also T^^^ - are functions of the BSC's 
crossover probability e. Also note, that in both cases tJ^'' is 
non-decreasing in z. 

We shall now state the residual codeword error probability, 
which can be achieved using an optimal set of thresholds for 
t > 1. To do this, we return to Theorem [T] more precisely 
to (|9]l in its proof. We saw that all terms in the maximization 
must be equal. Hence, we have the expression 

P. 



'Pi 



Using Lemma [T] gives 
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( z] ( z) 

i.e. / is defined by the largest threshold Tz within T. 

' (z) 

If we are restricted to one single threshold, P^ [ becomes 



P':^) :« (exp-(£;o(i?') + sTi(' 
'2£{d° - 1) 



exp - 



2^+1 



Eo{R')n\ 



(22) 



The opposite extremal case is an unlimited number of 
thresholds. To calculate Pj:°^\ we require the largest possible 
threshold, i.e. L'Hospital's rule for ( |20] | yields 

°° ■ s(£2 + l) 



In the same manner as before, we obtain 



P^f :« (exp - (^Eo{R') + sT^'' | n 
'2£{d° - 1) 



(oo)^„i\ ^+1 

oo 



exp - 



e + 
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Theorem 3 For GMD decoding of a concatenated code with 
inner ML and outer ^^BD decoding, i £ ¥1 \ {0, 1}, and 

a threshold set T = It^^\ . . . , Ti^H from Theorem |2] the 

(z) 

achievable residual codeword error rate [ is in the range 



p(oo) ^ p(z) ^ p(l) 
— -^e,£ — ^e,£ ' 

where P^ ^ is given by dU and pf) is given by i\22\l . 



For BSC crossover probability e 



(24) 



— > 0, the probabilities 
in (l24l l are almost equal. Moreover, P^^^ approaches the ML 
error probability exp — £'o(i?')n' as e goes to zero. By (l24l i. 
this happens even faster for P^^^ and P^^'. Morever, our 
experiments show that the ML error probability is already 
achieved for moderate channel conditions, especially if ^ ^ 1. 

Figure |2] shows exemplary residual error probability curves 
for a concatenated code with inner code C'(F2; 48, 24, d'), 
outer code C°(F224; 255, 223, 33) and outer 2±iBD-decoding 
with a varying number z of optimal thresholds. We observe 
that -^Y^BD decoding always beats BMD decoding. This could 
have been expected, since it can be shown that 



p: 



(^) 



e,l 



exp - 



2z{d° - 1] 
2z + l 



Eo{R')v}>P 



(^) 



■BMD, z = 1 
BMD, z = 2 
BMD, z = oo 




Fig. 2. Residual codeword error probabilities for z decoding trials. 



VII. Conclusions 

We investigated threshold-based multi-trial decoding of 
concatenated codes with inner ML and outer -^^^BD decoding. 
For any integer number z of decoding trials, i.e. thresholds, 
we gave an analytic formula for the optimal locations of 
the thresholds in a sense that the residual codeword error 
probability is minimized. We showed that for an arbitrary 
number of thresholds, outer ^^^^BD decoding outperforms 
outer BMD decoding and gave a range of achievable error 
probabilities. Within this range, the system designer can select 
z to meet given performance and complexity constraints. 

Our results can be applied to standardized concatenated 
coding schemes, e.g. for the CCSDS Telemetry Channel ifToll . 
It utilizes a set of t outer Reed-Solomon (RS) codes and 
an inner convolutional code. For a small modification of the 
standard the RS odes can be decoded collaboratively, 

i.e. they can be considered as an £-IRS code. For such codes, 
an efficient error/erasure ^-j^BD decoding algorithm has been 
proposed in lfT2l . Its complexity is the same as for decoding 
the £ RS codes separately. Hence, the complexity of multi-trial 
decoding with the outer ^^^iBD decoder grows only linearly 
in z. 

Another application of our results is decoding of generalized 
concatenated codes |i3J, U_3|. There, groups of outer RS codes 
can be combined into IRS codes as we already pointed out in 

ii. 
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